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Abstract. Considering a particular case of a problem posed by S. She- 
lah, we prove that the automorphism group of an infinitely generated 
free nilpotent group of cardinality A first-order interprets the full second- 
order theory of the set A in empty language. 



1. Introduction 

In his paper [8j of 1976, S. Shelah suggested a general program of the study 
of the logical strength of first-order theories of the automorphism groups of 
free algebras. Recently he has again attracted attention to that program in 
his survey [9|. Namely, the problem 3.14 from f9] asks for which varieties V 
of algebras, letting Fx for a free algebra in V with A ^ free generators, can 
we syntactically interpret in the first-order theory of Aut(-FA) the full second- 
order theory of the set A in empty language (possibly for sufficiently large 
cardinals A). Recall that a theory Tq in a logic Cq is said to be syntactically 
interpretable in a theory Ti in a logic Ci if there is a mapping x — )• x* from 
the set of all £o-sentences to the set of all >Ci-sentences such that 

X G To ^ X* G Ti. 

It should be pointed out that one the main results of [8] states that for 
any variety of algebras V the first-order theory of the endomorphism semi- 
group End(F\) syntactically interprets Th2(A) provided that a cardinal A 
is greater than or equal to the power of the language of V. The situation 
with the automorphism groups seems to be more difficult and the reason 
is obvious: despite being complicated in many cases, the endomorphism 
semi-groups of free algebras, as Shelah's analysis in [8] demonstrates, can 
be viewed as combinatorial objects. 

There exist only a few examples of varieties for which the Shelah's problem 
is completely investigated: some varieties have the desired property (for 
instance, the variety of all vector spaces over an arbitrary division ring and 
the variety of all groups [10\ [T2] ) , some do not (the variety of all sets with no 
structure [6l[7], the automorphism groups of free algebras are here symmetric 
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groups). To the best of the author's knowledge, there are no general results 
on the subject (however, Shelah introduces in O § 3] a wide class of so- 
called Aut-decomposable varieties, which are in many ways analogous to 
the variety of all sets). 

The purpose of the present paper is to prove that the automorphism 
groups Aut(FA) of free groups Fx in all varieties of nilpotent groups OT^ with 
s ^ 2 are logically strong enough to interpret by means of first-order logic 
the full second-order theory of A for all infinite A. We also consider a number 
of related questions; it is proved, in particular, that the first-order theory of 
the automorphism group of a finitely generated free nilpotent group of class 
^ 2 is unstable and undecidable. The author is grateful to Oleg Belegradek, 
Edward Formanek and Alexandre Iwanow for helpful discussions. 

Some of the results of this paper were announced at the International 
Conference "Logic and Algebra" (Istanbul, 2001); the author would like to 
express his gratitude to the organizers of the Conference for their warm 
hospitality. 

2. Reducing nilpotency class 

Suppose that is a free nilpotent group of class s ^ 2 and let KmiN), 
where m is a naturalnumber, denote the kernel of the homomorphism from 
the group Aut(A) to the group Aut(A^/A^m+i) induced by the natural ho- 
momorphism N N/Nm+i, from N to the free nilpotent group N/Nm+i of 
nilpotency class ra. In particular, Ki{N) is equal to lA(A^), to the subgroup 
of so-called 1 A- automorphisms of N, and Ks{N) = {id}. 

Lemma 2.1. Suppose that 7 is an 1 A.- automorphism. Then 7 commutes 
with every element of the subgroup Km{N) modulo the subgroup Km+i{N). 

Proof. According to the groups Km{N) form the lower central series of 
the group Ki{N) = lA(A^); every element of an arbitrary group G commutes 
with the elements of the fcth term of the lower central series of G modulo 
the {k + l)th term [3 Section 5.3]. □ 

Like in our previous papers [111 I13j . any automorphism 6 of N, which 
inverts all elements of some basis of N will be called a symmetry. 

Lemma 2.2. Let 9 be a symmetry. 

(a) Suppose that c is an element of Nm. Then 6 either fixes c modulo 
Nfn+i {when m is even), or inverts c modulo N^+i {when m is odd); 

(b) Suppose that 7 is an element of Km{N). Then the conjugate of ^ by 
9 either equals to 7 modulo Km+i{N) {when m is even) or to the inverse of 
7 modulo Km+i{N) {when m is odd). 

Proof, (a) Assume that B is a basis of N such that 9 sends each element of 
B to its inverse. Since the group Nm/Nm+i is abelian it suffices to prove 
that 9 acts in a prescribed way on generators [xi^ , , . . . , Xi^]Nm+\-, where 
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Xj^, . . . , Xj„ are elements of ;S |^ Section 5.3]. We have 

, [a^jj , • • • , Xj^]] = [xjj , [xj2 , • • • , a^im]^ ] 

= [a^ii, [xia, . . . ,Xi„]](~^)'"(modiVm+l)• 
(b) By (a). □ 

Suppose that is an involution from Aut(A^) and 991, (/?2, • • • , • • • are 
arbitrary conjugates of (/?. For every a in Aut(A^) let us construct the se- 
quence 

{dm ((/'I, 9^2, • • : m G N} 

of automorphisms of N as follows: 

CTi = (/?i(JoV?lCTo^"'^, 
(T2 = '/22fl'/'2<7l, 

= </'30"2¥'30"2^^, 



More formally, for every m ^ 

i\ J V^m+io-m9'm+icrm^\ if "I is even, 

|^(/7m+lO-m93m+lCrm, if "1 is odd. 

The following result generalizes the corresponding fact from proved 
there for free nilpotent groups of nilpotency class 2. 

Proposition 2.3. LetN he a free nilpotent group of nilpotency class s. Then 
an involution 9 € Aut(A^) is a symmetry modulo lA(A^) (that is, coincides 
with some symmetry modulo the group lA(A^)) if and only if for every a from 
Aut(A^) and every tuple 9i,92, ■ ■ ■ ,9s of conjugates of 9 the automorphism 
Csi0i,d2, ■ ■ ■ ,ds) of N is trivial. 

Proof. Suppose that 9 = 9*j, where 9* is a symmetry and 7 is an lA- 
automorphism. Since 9 is an involution, then 9*j = j^^9*. Any member 
9k of the tuple 9i,92, ■ ■ ■ ,9s, a symmetry modulo lA(A^), also has the form 
0*7fc for a suitable lA-automorphism 7^. 

Let us prove by induction on m that the automorphism am = o'm{9i, . . . ,9m) 
is an element of Km (N) . This will follow the necessity part of the Proposi- 
tion. 

Indeed, if m = 1, then am is an lA-automorphism, that is a member of 
Ki{N). Assume that am S Km{N) and let m be, for instance, even. We 
have by Lemma l2.2r b) and Lemma l2.1l 

Cm+l = Gm+lO'mGm+lO'm ^ = Im+l ^ am9* Jm+l(^m ^ 
= Im+l'^^CFmlm+lCymT^ = id(mod ETm+i (TV) ) . 
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Let US prove the converse. It is well-known that every automorphism of 
the abelianization N of N, the free abelian group N/[N, N], can be lifted up 
to an automorphism of N (see, for instance, O § 4] or [31 Section 3.1, Section 
4.2]). Then it suffices to prove that for every involution of Aut(A^), which 
is not —id, there exist an infinite sequence of the form (2.1), constructed 
inside Aut(A'^), which contains no trivial members. 

It can be seen quite easily that every involution / € Aut(A^), which is 
not — id, has two /-invariant direct summands B,C of N with N = B ® C 
and ranks = 2; moreover, the action oi f on B can chosen so that /{b is 
neither id^, nor — id^ ([13 Theorem 1.4], [2] Lemma 1]). This reduces the 
problem to the automorphism groups of two- generator free abelian groups; 
for the sake of simplicity we shall work with the group GL(2, Z). 

According to the just mentioned result from [2], every involution in GL(2, Z) 
is conjugate either to the involution 

1 

or to the involution 

'0 1 



.1 0/ 

hence the group GL(2, Z) has exactly two conjugacy classes of non-central 
involutions. One readily checks that for every integer m 

where ~ denotes the conjugacy relation. 

Let 5 be a non-central matrix from GL(2, Z) and m an integer number. 
Suppose that 

There are no difficulties in the verification of the following fact: some element 
of the 'general' matrix X (and Y) depends linearly on m. It follows that for 
a suitable integer m the matrix X{m) (Y(m)) is again non-central. This 
means that, starting with a non-central matrix, we can construct an infinite 
sequence of the form ()2.ip having no central matrices; in particular, there 
will be no trivial matrices in this sequence. Exactly the same argument, 
using matrices of the form 

1 
2m - 1 -1 

proves the similar result for the second conjugacy class of non-central invo- 
lutions in GL(2, Z). □ 



AUTOMORPHISM GROUPS OF FREE NILPOTENT GROUPS 



117 



Corollary 2.4. Symmetries modulo lA(A^) form a definable family in the 
group Aut(A^). 

Let T^{N) denote the set of all automorphisms {a} of N such that for 
every 9, which is a symmetry modulo 1A(A'^), the conjugate of cr by is 
equal to a~^. Similarly T^{N) denotes the set of all automorphisms of A^, 
which commute with every symmetry modulo lA(A^). 

Proposition 2.5. Let N be a free nilpotent group of nilpotency class s. Then 
Ks^i{N) = T^{N) LiT^{N). Therefore Kg^i^N), the kernel of a surjective 
homomorphism from Aut(A^) to the automorphism group of a free nilpotent 
group of nilpotency class s — 1 and of the same rank as one of N, is a 
definable subgroup of Aut{N). 

Proof. An arbitrary element a from T^{N) U T^{N) must commute with 
any product of two symmetries: if, for instance, a G T~{N), 9i and 62 are 
two symmetries then 

ei02fT(0i6'2)~^ = eie2(y020i = Oia-^Oi = a. 

On the other hand, one finds among the automorphisms of N, which can 
be expressed as a product of two symmetries, conjugations (inner automor- 
phisms of N) by primitive elements (that is, members of bases of N). This 
implies that a commutes with every element of Inn(A^). Hence a preserves 
each element of modulo the center of A^. The center of A^ is equal to the 
subgroup Ns O Section 3.1], and therefore a G Ars_i(A^). 

Let r be a conjugation by a primitive element x of A^. We are going to 
represent r as a product of two symmetries. The element x is a member of 
some basis B of A^. Suppose 9i is a symmetry, which inverts each element of 
B. Then if a symmetry 62 is defined as follows 

6*22; = 

02y = x~'^y~'^x, yy£B\{x}, 

the product of 6162 of 61 and 62 is equal to r. 

Conversely, according to Lemma 12.21 (b) every element of Ars_i(A^) either 
lies in T+(Af), or in r"(A^). □ 

3. Interpretations 

Theorem 3.1. Let N be a free nilpotent group of class ^ 2. Then the 
automorphism group of N first- order interprets the automorphism group of 
a free nilpotent group of class 2 and of rank which is the same as one of N 
{uniformly in N). 

Proof. By Proposition 12.51 □ 

Until otherwise stated, we shall assume that N is a free nilpotent group 
of class 2 and that A denotes the abelianization N of N. 

It can be shown that Inn(A^), the subgroup of all conjugations, is a 0- 
definable subgroup of Aut(A') [I3l Corollary 3.2]. The group Inn(A^) is 
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isomorphic to the free abehan group A. Thus, we can interpret in Aut(A^) 
the free abehan group A and the automorphism group of A with the action 
on the elements of A. 

We can also interpret in Aut(A^) the family V of all direct summands of 
A with inclusion relation and a binary relation, say R such that 

R{B,C)< — >A = B®C. 

One can prove that an involution / from Aut(A) is diagonalizable in some 
basis of A if only if there are no elements of order three in the set K{f)K{f), 
where K(f) denotes the conjugacy class of / (see proof of Proposition 2.4 
in [13]). Hence the fixed-point subgroups of diagonalizable involutions can 
be used to interpret the direct summands. Having the group A interpreted 
in Aut(A^), we can easily interpret the inclusion relation and the relation R 
on the family D. 

Summing up, we see that the group Aut(A^) first-order interprets the 
multi-sorted structure Ai with the following description: 

• the sorts of Ml are the free abelian group A, its automorphism group 
Aut(^) and the family V of all direct summands of A; 

• all sorts carry their natural relations; the relations of V are the 
inclusion relation and the relation R; 

• A4 has as one of the basic relations the membership relation on AUV; 

• there are relations defining the action of Aut(A^) on other sorts. 

Lemma 3.2. Let A be of infinite rank. Then the first- order theory of the 
structure A4 syntactically interprets the full second-order theory of the set 
\A\ (in empty language), uniformly in A. 

Proof. It follows from the results in Section 4 of [8], that the first-order 
theory of the endomorphism semi-group End(A) of A syntactically interprets 
Th2(|A|) (for the sake of convenience the reader may refer to [lOj, where the 
very similar case of varieties of vector spaces is considered in some details in 
the proof of Proposition 10.1; an analysis of the proof shows that it works 
also for free Z-modules, or, in other words, for free abelian groups). 

To complete the proof, we could therefore interpret in A4 the endomor- 
phism semi-group of A. There is a (folklore) trick by which the endomor- 
phisms can be interpreted in structures similar to A4 constructed over mod- 
ules. This trick can be briefly characterized as follows: three submodules, 
such that any two of them are direct complements of each other, are used 
to interpret the endomorphism semi-group of one of them. A detailed de- 
scription of the trick for infinite-dimensional vector spaces can be found in 
[To] (see the proof of Proposition 9.3); the reader is again referred to [lOj to 
see that everything works for free Z-modules as well. □ 

The following result solves the problem posed by S. Shelah (see the In- 
troduction) for all varieties of nilpotent groups ^I^, where s ^ 2. 
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Theorem 3.3. The first- order theory of the automorphism group of any in- 
finitely generated free nilpotent group N of class ^ 2 syntactically interprets 
the full second-order theory of the set \N\. The first-order theory of KvX{N) 
is therefore unstable and undecidahle. 

Proof. By Theorem 13.11 and Lemma 13.21 □ 

We have also solved the problem of classification of elementary types of 
the automorphism groups of infinitely generated free groups from varieties 

Theorem 3.4. Let Ni and N2 be infinitely generated free nilpotent groups of 
the same class ^ 2. Then the automorphism groups Aut(A^i) and Aut(A'^2) 
are elementarily equivalent if and only if the sets \Ni\ and \N2\ {with no 
structure) are equivalent in the full second-order logic. 

Proof. By Theorem 13.11 and Lemma 13.21 □ 

Let again denote a free nilpotent group of class 2 (recall that A stands 
for the abelianization of and A4 is the multi-sorted structure constructed 
over A). 

We are going to estimate the logical strength/complexity of the first-order 
theory of Aut(A^) in the case, when A^ is finitely generated. 

Lemma 3.5. Let A be of rank at least 2. Then the structure A4 first-order 
interprets (with parameters) the ring of integers Z. 

Proof. Let us consider two direct summands B,C oi A such that 

A = B®C and rank B = 2. 

Write G for the group of all automorphisms of A which preserve B and 
point-wise fix C. Clearly, the structure {G, B) with natural relations (that 
is, with all relations on sorts along with the action of G on B) is isomorphic 
to the two-sorted structure (GL(2,Z),Z^) (taken in the same language as 
one of (G, B)). It is a well-known and simple result that the latter two-sorted 
structure first-order interprets the ring of integers Z. □ 

As an immediate corollary we have the following fact. 

Theorem 3.6. Suppose that N is a finitely generated free nilpotent group of 
class ^ 2. Then the first-order theory of the group Aut(A^) is unstable and 
undecidable. 
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